Apparatus for providing information and method of providing information, and non-transitory storage medium

ABSTRACT

According to the present invention, there is provided an apparatus ( 10 ) for providing information, the apparatus including an acquisition unit ( 11 ) that acquires a captured image obtained by imaging the vicinity of a display; an image analysis unit ( 12 ) that detects a position on the display, which is being viewed by a person extracted from the captured image; and a control unit ( 13 ) that divides a display area of the display into multiple sub-areas, displays content on each of the multiple sub-areas, and makes a change to the displaying on the sub-area that is being viewed by the person extracted from the captured image.

This application is a National Stage Entry of PCT/JP2018/021581 filed onJun. 5, 2018, which claims priority from Japanese Patent Application2017-120735 filed on Jun. 20, 2017, the contents of all of which areincorporated herein by reference, in their entirety.

TECHNICAL FIELD

The present invention relates to an apparatus for providing information,a method of providing information, and a program.

BACKGROUND ART

In a method of displaying a visual image which is disclosed in PatentDocument 1, a display area of a display is divided into a main displayarea and a sub-display area, and a visual image is displayed on each ofthe main display area and the sub-display area. Furthermore, in thisdisplaying method, the visual image that draws a viewer's interest isdetected on the basis of information on a viewer's gaze information andlocation information on a viewer's face image. Then, in the displayingmethod, in a case where the visual image that draws the interest isdisplayed in the sub-display area, the replacement of visual images isperformed in such a manner that this visual image is displayed on themain display area.

In Patent Document 2, there is disclosed an apparatus for computingavailability, the apparatus including a line-of-sight informationacquisition unit that acquires information on a target person's line ofsight, a line-of-sight state decision unit that decides a state in whichmultiple target persons turn their gaze on an object, on the basis ofthe information on the target person's line of sight, a relationshipdecision unit that decides a relationship among the multiple targetpersons, and an availability computation unit that computes an indexvalue which indicates a likelihood that the object will be utilized bythe target person, on the basis of the relationship between the multipletarget persons, which are decided by the relationship decision unit, andon the state decided by the line-of-sight state decision unit.

In a method of displaying content which is disclosed in Patent Document3, based on a recognition time of a gaze on a display panel and on thenumber of times that a gaze is diverted away from the display panel, anaffirmation level that results from recognizing the gaze is obtained,and, based on the affirmation level, an evaluation is made of anadvertisement that is displayed on the display panel. Then, based on aresult of the evaluation, an advertisement that is to be displayed onthe display panel is decided.

RELATED DOCUMENT Patent Document

[Patent Document 1] Japanese Unexamined Patent Application No.2011-146048 [Patent Document 2] Japanese Unexamined Patent ApplicationNo. 2016-122272 [Patent Document 3] Japanese Unexamined PatentApplication No. 2015-64513

SUMMARY OF THE INVENTION Technical Problem

There has been a problem that an advantage (for example, theeffectiveness of the advertisement) that results from providinginformation cannot be enjoyed because content displayed on the displayis not suitably changed depending on a situation of the viewer.

Solution to Problem

According to an aspect of the present invention, there is provided anapparatus for providing information, the apparatus including anacquisition unit that acquires a captured image obtained by imaging thevicinity of a display; an image analysis unit that detects a position onthe display, which is being viewed by a person extracted from thecaptured image; and a control unit that divides a display area of thedisplay into multiple sub-areas, displays content on each of themultiple sub-areas, and makes a change to the displaying on the sub-areathat is being viewed by the person extracted from the captured image.

Furthermore, according to another aspect of the present invention, thereis provided an apparatus for providing information, the apparatusincluding an acquisition unit that acquires a captured image obtained byimaging the vicinity of a display; an image analysis unit that analyzesthe captured image, to extract a face of a person from the capturedimage and detect the number of persons who are viewing the display, anda display browsing time that is a period of time for which the displayis being viewed; and a control unit that decides content that is to bedisplayed on the display, according to a result of the detection.

Furthermore, according to still another aspect of the present invention,there is provided a method of providing information, which is performedby a computer, the method including: an acquisition step of acquiring acaptured image obtained by imaging the vicinity of a display; an imageanalysis step of detecting a position on the display, which is beingviewed by a person extracted from the captured image; and a control stepof dividing a display area of the display into multiple sub-areas,displaying content on each of the multiple sub-areas, and making achange to the displaying on the sub-area that is being viewed by theperson extracted from the captured image.

Furthermore, according to still another aspect of the present invention,there is provided a program that causes a computer to function as: anacquisition unit that acquires a captured image obtained by imaging thevicinity of a display; an image analysis unit that detects a position onthe display, which is being viewed by a person extracted from thecaptured image; and a control unit that divides a display area of thedisplay into multiple sub-areas, displays content on each of themultiple sub-areas, and makes a change to the displaying on the sub-areathat is being viewed by the person extracted from the captured image.

Furthermore, according to still another aspect of the present invention,there is provided a method of providing information, which is performedby a computer, the method including: an acquisition step of acquiring acaptured image obtained by imaging the vicinity of a display; an imageanalysis step of analyzing the captured image, to extract a face of aperson from the captured image and detect the number of persons who areviewing the display, and a display browsing time that is a period oftime for which the display is being viewed; and a control step ofdeciding content that is to be displayed on the display, according to aresult of the detection.

Furthermore, according to still another aspect of the present invention,there is provided a program that causes a computer to function as: anacquisition unit that acquires a captured image obtained by imaging thevicinity of a display; an image analysis unit that analyzes the capturedimage, to extract a face of a person from the captured image, and detectthe number of persons who are viewing the display, and a displaybrowsing time that is a period of time for which the display is beingviewed; and a control unit that decides content that is to be displayedon the display, according to a result of the detection.

Advantageous Effects of Invention

According to the present invention, depending on a situation of aviewer, a change can be suitably made to content that is displayed on adisplay.

BRIEF DESCRIPTION OF THE DRAWINGS

The object described above and other objects, and features andadvantages are further made apparent by suitable example embodimentsthat will be described below and the following drawings that arereferred to for the description of the suitable example embodiments.

FIG. 1 is a block diagram illustrating an example of a hardwareconfiguration of an apparatus for providing information according to thepresent example embodiment.

FIG. 2 is an example of a functional block diagram of the apparatus forproviding information according to the present example embodiment.

FIG. 3 is a diagram schematically illustrating an example of data thatis generated by the apparatus for providing information according to thepresent example embodiment.

FIG. 4 is a diagram schematically illustrating an example of a mode fordisplaying on a display according to the present example embodiment.

FIG. 5 is a block diagram illustrating an example of a flow forprocessing by the apparatus for providing information according to thepresent invention.

FIG. 6 is a diagram schematically illustrating an example of informationthat is utilized by the apparatus for providing information according tothe present example embodiment.

FIG. 7 is a diagram schematically illustrating an example of the modefor the displaying on the display according to the present exampleembodiment.

FIG. 8 is a diagram schematically illustrating an example of informationthat is generated by the apparatus for providing information accordingto the present example embodiment.

FIG. 9 is a diagram schematically illustrating an example of theinformation that is generated by the apparatus for providing informationaccording to the present example embodiment.

FIG. 10 is a diagram schematically illustrating an example of theinformation that is generated by the apparatus for providing informationaccording to the present example embodiment.

FIG. 11 is a diagram schematically illustrating an example of theinformation that is generated by the apparatus for providing informationaccording to the present example embodiment.

FIG. 12 is a block diagram illustrating an example of the flow forprocessing by the apparatus for providing information according to thepresent invention.

DESCRIPTION OF EMBODIMENTS First Example Embodiment

First, a general outline of an information providing system according tothe present example embodiment is described. The information providingsystem according to the present example embodiment is a so-calleddigital signage system (this is also true for all of the followingexample embodiments). The information providing system includes adisplay that is installed in an arbitrary place, a camera thatimage-captures the vicinity of the display, and an apparatus forproviding information that controls the display.

The display is installed in an arbitrary place. For example, the displayis installed outdoors, indoors, or in a public area. The display outputspredetermined content (for example, a moving image, a still image, oraudio) according to the control of the display. A file that contains thecontent which is to be output may be stored in advance in a memorydevice, and may be input from an external apparatus (for example, anapparatus for providing information) into the display.

The camera is configured in a manner that possibly captures a movingimage. It should be noted that the camera may be configured in a mannerthat possibly captures still images successively every predeterminedtime (for example, every second). The camera is installed (fixed) at alocation where the vicinity of the display (for example, a front areawhere a person who is watching the display is positioned) is possiblyimage-captured. Then, the camera transmits an image file (a moving imagefile or a still image file) that is generated by real-time processing tothe apparatus for providing information.

The apparatus for providing information has an acquisition unit, animage analysis unit, and a control unit. The acquisition unit acquires acaptured image (an image file) obtained by imaging the vicinity of thedisplay. By analyzing the captured image, the image analysis unit notonly extracts the face of a person from the captured image, but alsodetects a position on the display, which is being viewed by theextracted person. The control unit divides a display area of the displayinto multiple sub-areas. The control unit not only displays content oneach of the multiple sub-areas, but also makes a change to thedisplaying on a sub-area that is being viewed by the person extractedfrom the captured image. For example, a change is made to the contentthat is displayed on the sub-area.

With the apparatus for providing information, a change is made tocontent that is displayed on a sub-area which is being viewed by aviewer without the content remaining the same (that is, the contentundergoes a change), and thus viewer's attention to the sub-area can beincreased much more. Particularly, a change is made to only the contentthat is displayed on the sub-area which is being viewed by the viewerinstead of changes being made to items of content on all of the multiplesub-areas, and thus the viewer's attention to the sub-area can beincreased much more.

Furthermore, a change is made to only content that is displayed on onesub-area (the sub-area that is being viewed by the viewer) instead ofchanges being made to items of content on all of the multiple sub-areas,and thus a load on processing by the display can be reduced.

Furthermore, a change is made to the content that is displayed on thesub-area which is being viewed by the viewer without the contentremaining the same, and thus a greater amount of information can betransferred efficiently to the viewer.

It should be noted that the apparatus for providing information may beinstalled close to the display. The display and the apparatus forproviding information may be configured to be integrated physicallyand/or logically into one piece and may be configured to be segmentedfrom each other. In the case of the latter, the display and theapparatus for providing information are configured in a manner thatpossibly performs communication using arbitrary means.

In addition, the apparatus for providing information may be installed ata location that is at some distance away from the display, and thedisplay may be controlled remotely. In this case, the display and theapparatus for providing information may be connected to each otherthrough a communication network such as the Internet and may beconnected to each other through a dedicated communication network.

The display and the camera that are included in the informationproviding system according to the present example embodiment can berealized in compliance with technologies in the related art. Aconfiguration of the apparatus for providing information will bedescribed in detail below.

First, an example of a hardware configuration of the apparatus forproviding information is described. Each function unit that is includedin the apparatus for providing information according to the presentexample embodiment may be realized with any combination of hardware andsoftware based on a central processing unit (CPU) of an arbitrarycomputer, a memory, a program that is loaded onto the memory, a storageunit (it is possible to store a program that is downloaded from astorage medium, such as a compact disc (CD), a server on the Internet,or the like, in addition to a program that is stored in advance from astage at which the apparatus is shipped), such as a hard disk whichstores the program, and an interface for connection to a network. Then,it is understood by a person of ordinary skill in the art that there arevarious examples of modification to the method or apparatus thatrealizes this.

FIG. 1 is a block diagram illustrating the hardware configuration of theapparatus for providing information according to the present exampleembodiment. As illustrated in FIG. 1, the apparatus for providinginformation has a processor 1A, a memory 2A, an input and outputinterface 3A, a peripheral circuit 4A, and a bus 5A. Various modules areincluded in the peripheral circuit 4A. It should be noted that theapparatus for providing information may be configured with multipleapparatuses that are physically or logically separated. In this case,each of the multiple apparatuses may have the processor 1A, the memory2A, the input and output interface 3A, the peripheral circuit 4A, andthe bus 5A.

The bus 5A is a data transfer path for data reception and transmissionthat are performed among the processor 1A, the memory 2A, the peripheralcircuit 4A, and the input and output interface 3A. The processor 1A isan arithmetic processing unit, such a CPU or a graphic processing unit(GPU). The memory 2A, for example, is a memory, such as a random accessmemory (RAM) or a read only memory (ROM). The input and outputinterfaces 3A include an interface for acquiring information from aninput device (for example, a keyboard, a mouse, a microphone, a physicalkey, a touch panel display, a code reader, or the like), an externalapparatus, an external server, an external sensor, or the like, and aninterface for outputting information to an output device (for example, adisplay, a speaker, a printer, a mailer, or the like), an externalapparatus, an external server, or the like. The processor 1A can outputa command to each module and can perform arithmetic operation on thebasis of results of arithmetic operations by these modules.

Next, a functional configuration of the apparatus for providinginformation will be described. FIG. 2 illustrates an example of afunctional block diagram of an apparatus 10 for providing information.As described, the apparatus 10 for providing information has anacquisition unit 11, an image analysis unit 12, and a control unit 13.

The acquisition unit 11 acquires the captured image (the image file)obtained by imaging the vicinity of the display, from the cameradescribed above. The image file includes multiple captured images(frames). The acquisition unit 11 may acquire information that possiblydetermines the date and time at which each of multiple captured imagesis captured, from the camera described above.

By analyzing the captured image, the image analysis unit 12 not onlyextracts the face of a person from the captured image, but also aposition on the display, which is being viewed by the extracted person(first detection process). Furthermore, the image analysis unit 12detects a sub-area browsing time that is a period of time for which theperson who is extracted from the captured image is viewing apredetermined sub-area (a sub-area that is being viewed at the timing ofthe image-capturing) (second detection process). The image analysis unit12 may analyze all captured images that are included in the image file,and may analyze an image captured every predetermined time (for example,every second or every 3 seconds).

First, the first detection process is described. Means for extractingthe face of the person from the captured image is not particularlylimited, and every technology in the related art can be employed.

Furthermore, the image analysis unit 12 can detect a position on thedisplay, which is being viewed by the extracted person, by utilizingevery technology in the related art. For example, the position on thedisplay, which is being viewed by the person, can be detected on thebasis of a direction of the person's gaze, a distance between the personand the camera, a position of the face of the person within the capturedimage, a relative relationship that is retained in advance between thecamera and the display (for example, an angle between an optical axis ofthe camera and a display area (a surface) of the display, a distancebetween the camera and the display, or the like).

The direction of the gaze of the person may be determined by imageanalysis and may be determined by other means. In the case of the imageanalysis, the direction of the gaze can be inferred, for example, on thebasis of a direction of the face, a position of an eyeball, or the like.The direction of the face can be estimated on the basis of a position ofa characteristic portion, such as an eye, a nose, or a mouth, within aface area, a relative positional relationship among these, or the like.

Furthermore, the distance between the person and the camera may bedetermined by the image analysis or may be determined by other means. Inthe case of the image analysis, for example, inference can be made onthe basis of a size of the face (an area occupied within the capturedimage) or the like.

FIG. 3 schematically illustrates an example of data resulting from theanalysis, which is generated by the first detection process. Forexample, the image analysis unit 12 analyzes the captured imagetransmitted from the camera, by real-time processing, and adds a newresult of the analysis to the data resulting from the analysis.

In the data resulting from the analysis, which is illustrated, anextraction identifier (ID), a browsing person ID, a month and date, atime, a browsing position and a position within an image are associatedwith each other. It should be noted that other pieces of information maybe included.

“month and date and time” indicates a date and time at which eachcaptured image (each frame) was captured. In the case of an example thatis illustrated, it is understood that extraction IDs 0000001 to 0000003,of which these pieces of information are consistent with one other, arepieces of information that are obtained by analyzing the same capturedimage. In the same manner, it is understood that extraction IDs 0000004to 0000006 are pieces of information that are obtained by analyzing thesame captured image.

“extraction ID” is an ID that is attached each time a person isextracted from the captured image. In a case where multiple persons areextracted from one image, different IDs are attached to the multipleextractions, respectively. Furthermore, in a case where a certain personis extracted from a first captured image and a second captured image,different extraction IDs are attached to the extractions, respectively.

“browsing person ID” is an ID that is attached to each of the personswho are extracted from the captured image. The image analysis unit 12groups faces that are considered as be ones of the same persons who arepresent across multiple captured images, into one group, and attachedone browsing person ID to the one group.

For example, the image analysis unit 12 associates faces of the samepersons who are present across the first and second captured images,with each other, on the basis of positions of n (n is equal to orgreater than 1) faces that are extracted from the first captured image,within the captured image, and on positions of m (m may be equal to orgreater than 1 and may be the same as n) faces that are extracted fromthe second captured image that immediately follows the first capturedimage. For example, faces may be associated with each other if theysatisfy the condition that “a distance between a position (positionwithin image that is illustrated in FIG. 3) of a face, within thecaptured image, which is extracted from the first captured image and aposition (position within image that is illustrated in FIG. 3) of aface, within the captured image, which is extracted from the secondcaptured image, is equal to or greater than a predetermined value.”

This processing is performed on all pairs of two captured images thatare successive one after another, and thus faces of the same persons whoare present successively within the captured images can be grouped intoone group. Then, the image analysis unit 12 can attach the browsingperson ID to every group.

It should be noted that as another example of the processing, the imageanalysis unit 12 may extract a feature value of the face of each of thepersons extracted from the captured image. Then, the same persons whoare present across multiple captured images may be grouped into onegroup by utilizing the feature value and the browsing person ID may beattached to every group.

In the present example embodiment, any method can be employed. However,in the case of the former, there is no need to acquire information (afeature value of a face) that identifies a browsing person. For thisreason, the former can be said to be a preferable method that isemployed to ensure privacy.

“browsing position” indicates a position on the display, which is beingviewed by each of the extracted persons. For example, the browsingposition may be indicated with a two-dimensional coordinate system inwhich an arbitrary position on the display is set to be an origin and inwhich arbitrary directions with respect to the display are to be anx-axis and a y-axis, respectively. It should be noted that in a casewhere the browsing position is not on the display, informationindicating that the browsing position is not on the display may beregistered. In the case of an example that is illustrated, extraction ID0000003 has a browsing position that is empty. Accordingly, it isunderstood that at 13:00:01 on Jun. 1, 2017, ID V00003 did not visuallyrecognize anywhere on the display.

“position within image” indicates a position of the face of each of theextracted persons, within the captured image. For example, a position ofa face within the captured image may be indicated with a two-dimensionalcoordinate system in which an arbitrary position within the capturedimage is set to be an origin and in which arbitrary directions withrespect to the captured image are to be an x-axis and a y-axis,respectively.

Next, the second processing will be described. As described above, inthe second processing, the image analysis unit 12 detects the sub-areabrowsing time that is the period of time for which the person extractedfrom the captured image is viewing a predetermined sub-area (a sub-areathat is being viewed at the timing of the image-capturing). The sub-areabrowsing time may be a period of time for which the person successivelybrowses the predetermined sub-area without averting the person's eyesfrom it, until the timing of the image-capturing, and may be acumulative time for which the person browses the sub-area until thetiming of the image-capturing.

For example, on the basis of the data resulting from the analysis, whichis illustrated in FIG. 3, the image analysis unit 12 detects a period oftime for which each of the persons extracted from the most recentlycaptured image views a sub-area that is being viewed at the timing ofthe image-capturing, until the timing of the image-capturing.

In the present example embodiment, as illustrated in FIG. 4, the displayarea 100 of a display D is divided into multiple sub-areas 101 to 104,and content is displayed on each of the multiple sub-areas 101 to 104.The number of the sub-areas or a layout is not limited to the one thatis illustrated.

The image analysis unit 12 in advance retains layout information on themultiple sub-areas. Then, on the basis of the layout information and,for example, information on the browsing position that is included inthe data resulting from the analysis, as illustrated in FIG. 3, theimage analysis unit 12 can determine which sub-area each personextracted at each timing is viewing. Then, on the basis of a result ofthe determination, the image analysis unit 12 can compute the sub-areabrowsing time described above.

With reference again to FIG. 2, for example, the control unit 13, asillustrated in FIG. 4, divides the display area 100 of the display Dinto the multiple sub-areas 101 to 104 and displays content on each ofthe multiple sub-areas 101 to 104. The number of the sub-areas or thelayout is not limited to the one that is illustrated.

Furthermore, the control unit 13 makes a change to the displaying on asub-area that is being viewed by a person extracted from the capturedimage. For example, the control unit 13 decides content that is to bedisplayed on a sub-area which is being viewed at the timing of theimage-capturing by each of the persons extracted from the most recentlycaptured image, according to the sub-area browsing time for which thesub-area is viewed until the timing of the image-capturing. Then, thecontrol unit 13 displays the decided content on the sub-area. Forexample, an advertisement or the like is given as an example of thecontent that is to be displayed, but no limitation to this is imposed.

For example, the control unit 13 may display a still image in a casewhere the sub-area browsing time is shorter than a first reference timeand may display a moving image in a case where the sub-area browsingtime is equal to or longer than the first reference time. The firstreference time is arbitrarily set in advance. The still image is notlimited to an entire sub-area being necessarily stationary, and aportion (for example, a letter, a symbol, or the like, which are not theadvertisement itself) of the image may move.

Furthermore, when the sub-area browsing time is equal to or longer thanthe second reference time, the control unit 13 may display couponinformation. The second reference time is arbitrarily set in advance.

The following processing can be realized by combining these twoexamples. For example, the display is installed in a shopping center inwhich multiple stores concentrate. First, the control unit 13 displaysattribute information (a name, a place, a photograph of an externalappearance, a product, or the like) of each of the multiple stores oneach of the multiple sub-areas, using a still image.

Then, when a certain person views a certain sub-area and the sub-areabrowsing time for which the sub-area is being viewed is equal to orlonger than the first reference time, the control unit 13 starts toreproduce a moving image including more detailed information on thestore on the sub-area.

It should be noted that when the browsing position of the person who isviewing the sub-area moves out of the sub-area while the reproduction isin progress, the control unit 13 may temporarily stop reproducing themoving image. Then, when the browsing position of the person returns tothe sub-area, the temporary stop may be canceled and the reproductionmay be resumed starting from a point in the moving image where thetemporary stopping occurs. Furthermore, while the reproduction is inprogress, when the person who is viewing the sub-area is not includedthe captured image (when the person is not present in front of thedisplay), the control unit 13 may stop reproducing the moving image andmay return to displaying of the original still image on the sub-area.

Then, when the reproduction of the moving image is finished to the end,the control unit 13 displays coupon information on the store on thesub-area. The displaying of the coupon information in response to thefinishing of the reproduction of the moving image can be realized bysuitably setting the second reference time.

It should be noted that the control unit 13 can individually make achange to content that is displayed on each of the multiple sub-areas,without making a change to a layout (a size, a specification forarrangement, or the like) of the multiple sub-areas on the display.

In addition, in a case where the face of a person is not extracted fromthe captured image, the control unit 13 may cause the display to operatein a power saving mode. In the power saving mode, the display performsan operation that consumes less power than in a normal mode. Forexample, in the power saving mode, brightness of the display is lowerthan in the normal mode.

In addition, the control unit 13 may introduce a store or the like usinga detailed moving image containing a detail, on a sub-area that is beingviewed by a person, and may introduce a store or the like using a movingimage containing a digest or simple information, on a sub-area that isnot being viewed by a person. Furthermore, the control unit 13 maydisplay a still image that is one portion of the moving image, on asub-area that is not being viewed by a person, and may display a movingimage on a sub-area that is being viewed by a person.

In addition, the control unit 13 may display a moving image containing adigest or simple information (for example, information that introducesan outline of a store or the like) in a case where the sub-area browsingtime is shorter than the first reference time, and may display a movingimage containing detailed information (for example, information thatintroduces a detail of a store or the like) when the sub-area browsingtime becomes equal to or longer than the first reference time.

Next, with reference to FIG. 5, an example of a flow for processing bythe apparatus 10 for providing information according to the presentexample embodiment will be described.

In S11, the acquisition unit 11 acquires the captured image obtained byimaging the vicinity of the display.

In S12, by analyzing the captured image, the image analysis unit 12 notonly extracts the face of a person from the captured image, but alsodetects a position on the display, which is being viewed by theextracted person. Furthermore, for example, on the basis of the dataresulting from the analysis, as illustrated in FIG. 3, the imageanalysis unit 12 detects a period of time (the sub-area browsing time)for which each of the persons extracted from the most recently capturedimage views a sub-area that is being viewed at the timing of theimage-capturing, until the timing of the image-capturing.

In S13, the control unit 13 makes a change to the displaying on asub-area according to the sub-area browsing time for which a personextracted from the captured image is viewing the sub-area. For example,the control unit 13 decides content that is to be displayed on thesub-area according to the sub-area browsing time. Then, the control unit13 displays the decided content on the sub-area.

Thereafter, while a signal that ends processing is not input (No inS14), the processing described above is repeated.

With the information providing system according to the present exampleembodiment, which is described above, a change is made to the contentthat is displayed on the sub-area which is being viewed by the viewerwithout the content remaining the same (that is, the content undergoes achange), and thus the viewer's attention to the sub-area can beincreased much more. Particularly, a change is made to only the contentthat is displayed on the sub-area which is being viewed by the viewerinstead of changes being made to items of content on all of the multiplesub-areas, and thus the viewer's attention on the sub-area can beincreased much more.

Furthermore, a change is made to only the content that is displayed onone sub-area (the sub-area that is being viewed by the viewer) insteadof changes being made to items of content on all of the multiplesub-areas, and thus the load on the processing by the display can bereduced.

Furthermore, a change is made to the content that is displayed on thesub-area which is being viewed by the viewer without the contentremaining the same, and thus a greater amount of information can betransferred efficiently to the viewer.

Furthermore, with the information providing system according to thepresent example embodiment, the period of time (the sub-area browsingtime) for which a person is viewing a predetermined sub-area can bedetected, and content that is to be displayed on the predeterminedsub-area can be accordingly decided. A change is made to the contentthat is displayed according to a change in the sub-area browsing time,and thus a viewer's interest can be drawn without the viewer being boredwith the content that is displayed on the sub-area.

Furthermore, when, without considering the sub-area browsing time, achange is simply made to the content that is displayed only in responseto the visitor's viewing, there is a likelihood that switching processwill be performed unnecessarily on content. For example, there is alikelihood that a change will be made to content each time a pass-byglances at a sub-area. According to the present example embodiment,switching is performed on content due to the sub-area browsing timeexceeding a threshold, and thus a process for switching to unnecessarycontent can be avoided.

Second Example Embodiment

An information providing system according to the present exampleembodiment has a different configuration of the apparatus 10 forproviding information than that according to the first exampleembodiment. That is, configurations of the display and the camera arethe same as those according to the first example embodiment.

The apparatus 10 for providing information according to the presentexample embodiment is different from that according to the first exampleembodiment, in that details of control of the display are decided on thebasis of the sub-area browsing time, which is described in the firstexample embodiment, and the number of persons who are viewing each ofthe multiple sub-areas. Other configurations are the same as thoseaccording to the first example embodiment. The details will be describedbelow.

An example of the hardware configuration of the apparatus 10 forproviding information is the same as that according to the first exampleembodiment.

An example of the functional block of the apparatus 10 for providinginformation according to the present example embodiment is illustratedin FIG. 2 in the same manner as that according to first exampleembodiment. As described, the apparatus 10 for providing information hasthe acquisition unit 11, the image analysis unit 12, and the controlunit 13. A configuration of the acquisition unit 11 is the same as thataccording to the first example embodiment.

In addition to the function which is described in the first exampleembodiment, the image analysis unit 12 further has a function ofdetecting the number of the persons who are viewing each of the multiplesub-areas.

For example, the image analysis unit 12 detects the number of thepersons who are viewing each of the multiple sub-areas, within the mostrecently captured image. Furthermore, as described according to thefirst example embodiment, the image analysis unit 12 detects the periodof time (the sub-area browsing time) for which each of the personsextracted from the most recently captured image views a sub-area that isbeing viewed at the timing of the image-capturing, until the timing ofthe image-capturing.

For example, the control unit 13, as illustrated in FIG. 4, the displayarea 100 of the display D is divided into the multiple sub-areas 101 to104 and displays content on each of the multiple sub-areas 101 to 104.The number of the sub-areas or the layout are not limited to the onethat is illustrated.

Furthermore, the control unit 13 makes a change to the displaying on thesub-area that is being viewed by the person extracted from the capturedimage. For example, the control unit 13 makes a change to the contentthat is displayed on the sub-area.

The control unit 13 according to the present example embodiment decidesthe content that is to be displayed on the sub-area which is beingviewed at the timing of the image-capturing by each of the personsextracted from the most recently captured image, according to thesub-area browsing time for which the sub-area is viewed until the timingof the image-capturing and the number of the persons who are viewing thesub-area at the timing of the image-capturing. Then, the decided contentis displayed on the sub-area. It should be noted that the control unit13 can individually make a change to the content that is displayed oneach of the multiple sub-areas, without making a change to the layout (asize, a specification for arrangement, or the like) of the multiplesub-areas on the display.

For example, the control unit 13 may display a still image in a casewhere the number of the persons, the sub-area browsing time of each ofwhom is equal to or shorter than a third reference time, is smaller thanthe first reference number of persons, and may display a moving image ina case where the number of the persons, the sub-area browsing time ofeach of whom is equal to or longer than the third reference time, isequal to or greater than the first reference number of persons. Thethird reference time and the first reference number of persons arearbitrarily set in advance. The still image is not limited to an entiresub-area being necessarily stationary, and a portion (for example, aletter, a symbol, or the like, which are not the advertisement itself)of the image may move.

Furthermore, the control unit 13 may display a moving image containing adigest or simple information (for example, information that introducesan outline of a store or the like) in a case where the number of thepersons, the sub-area browsing time of each of whom is equal to orlonger than the third reference time, is smaller than the firstreference number of persons, and may display a moving image containingdetailed information (for example, information that introduces a detailof a store or the like) in a case where the number of the persons, thesub-area browsing time of each of whom is equal to or longer than thethird reference time, is equal to or greater than the first referencenumber of persons.

Furthermore, the control unit 13 may display coupon information when thenumber of the persons, the sub-area browsing time of each of whom isequal to or longer than a fourth reference time, is equal to or greaterthan a second reference number of performs. The fourth reference timeand the second reference number of persons are arbitrarily set inadvance.

As a modification example of the present example embodiment, the controlunit 13 may make a change to a layout of multiple sub-areas on thedisplay, according to the number of the persons who are viewing each ofthe multiple sub-areas. For example, the control unit 13 may set a ratioof an area occupied by at least one of the multiple sub-areas on thedisplay to be a ratio in accordance with a ratio of the number of thepersons who are viewing the sub-area. In addition, the control unit 13may perform control in such a manner that the greater the number of thepersons who are viewing a sub-area, the greater a ratio of an areaoccupied by the sub-area.

Furthermore, the control unit 13 may perform switching on brightness ofeach of the multiple sub-areas on the display, according to the numberof the persons who are viewing each of the multiple sub-areas. In thiscase, the control unit 13 may set the brightness to be low in a casewhere the number of persons who are viewing the sub-area is smaller thana predetermined number (for example, is smaller than 1), and may set thebrightness to be high in a case where the number of persons who areviewing the sub-area is equal to or greater than the predeterminednumber (for example, is equal to or greater than 1). In addition, thecontrol unit 13 may increase the brightness according to an increase inthe number of the persons who are viewing the sub-area.

Furthermore, in a case where the face of a person is not extracted fromthe captured image, the control unit 13 may cause the display to operatein the power saving mode.

Furthermore, in a case where the face of a person is extracted from thecaptured image, but where the number of the persons who are viewing thedisplay is smaller than the predetermined number (for example, issmaller than 1), the control unit 13 may cause the display to perform anoperation of drawing person's attention. For example, the audio saying“we provide useful information” or the like may be output on thedisplay, and person's attention may be drawn using a blinking light orthe like.

Next, with reference to FIG. 12, an example of a flow for processing bythe apparatus 10 for providing information according to the presentexample embodiment will be described.

In S21, the acquisition unit 11 acquires the captured image obtained byimaging the vicinity of the display.

In S22, by analyzing the captured image, the image analysis unit 12 notonly extracts the face of a person from the captured image, but alsodetects a position on the display, which is being viewed by theextracted person. Furthermore, for example, on the basis of the dataresulting from the analysis, as illustrated in FIG. 3, the imageanalysis unit 12 detects the period of time (the sub-area browsing time)for which each of the persons extracted from the most recently capturedimage views the sub-area that is being viewed at the timing of theimage-capturing, until the timing of the image-capturing, and the numberof the persons who are viewing each of the multiple sub-areas at thetiming of the image-capturing.

S23, the control unit 13 makes a change to the displaying on a sub-areaaccording to the sub-area browsing time for which a person extractedfrom the captured image is viewing the sub-area and the number of thepersons who are viewing the sub-area. For example, the control unit 13decides content that is to be displayed on the sub-area according to thesub-area browsing time and the number of the persons who are viewing thesub-are. Then, the control unit 13 displays the decided content on thesub-area. For example, the control unit 13 may display a still image inthe case where the number of the persons, the sub-area browsing time ofeach of whom is equal to or shorter than the third reference time, issmaller than the first reference number of persons, and may display amoving image in the case where the number of the persons, the sub-areabrowsing time of each of whom is equal to or longer than the thirdreference time, is equal to or greater than the first reference numberof persons.

Thereafter, while a signal that ends processing is not input (No inS24), the processing described above is repeated.

With the information providing system according to the present exampleembodiment, which is described above, an advantageous effect that is thesame as that according to the first example embodiment can be realized.

Furthermore, with the information providing system according to thepresent example embodiment, in response to the predetermined number ofpersons or greater gazing at a sub-area, switching can be performed oncontent that is displayed on the sub-area. With such a method, forexample, in a case where a group of multiple persons are browsing thedisplay, by performing switching on content that is displayed, contentthat draws an interest, among a group of items of content can be easilyrecognized.

For example, when pieces of guide information “when n or more personsfix their gaze on an advertisement of a predetermined store, switchingis performed on contents of the advertisement,” “when n or more personsfix their gaze on an advertisement of a predetermined store and watchthe advertisement in a moving image to the end, a wonderful present isprovided,” and so forth are provided in advance to browsing persons, thebrowsing persons can enjoy browsing with a feeling of playing a game. Inthis case, because it can be expected that the number of persons whoviews an advertisement increases, the effectiveness of the advertisementincreases.

Third Example Embodiment

An information providing system according to the present exampleembodiment has a different configuration of the apparatus 10 forproviding information than those according to the first and secondexample embodiments. That is, configurations of the display and thecamera are the same as those according to the first and second exampleembodiments. The details will be described below.

An example of the hardware configuration of the apparatus 10 forproviding information is the same as those according to the first andsecond example embodiments.

An example of a functional block of the apparatus 10 for providinginformation according to the present example embodiment is illustratedin FIG. 2 in the same manner as those according to the first and secondexample embodiments. As described, the apparatus 10 for providinginformation has the acquisition unit 11, the image analysis unit 12, andthe control unit 13. A configuration of the acquisition unit 11 is thesame as those according to the first and second example embodiments.

The image analysis unit 12 performs the first detection processaccording to the first example embodiment, which is described above,and, for example, obtains the data resulting from the analysis asillustrated in FIG. 3. It should be noted that the image analysis unit12 may perform the second detection process according to the firstexample embodiment, which is described above.

Then, on the basis of the data resulting from the analysis, which isdescribed above, the image analysis unit 12 detects the number of thepersons who are viewing the display, and a period of time (a displaybrowsing time) for which the display is browsed, until the timing of theimage-capturing, from the most recently captured image. Furthermore, theimage analysis unit 12 may detect a position on the display, which isbeing viewed by each of the extracted persons. The display browsing timemay be a period of time for which the person successively browses thedisplay without averting the person's eyes from it, until the timing ofthe image-capturing, and may be a cumulative time for which the personbrowses the display until the timing of the image-capturing.

The control unit 13 decides the detail of the control of the display,for example, content that is to be displayed, or an operation mode,according to a result of the detection by the image analysis unit 12.

For example, the control unit 13 may retain in advance correspondenceinformation, as illustrated in FIG. 6, which results from associating aperiod of time (the display browsing time) that elapsed after a gaze isdetected, the number of the persons who are viewing the display, and thedetail of the control of the display with each other. Then, on the basisof the correspondence information, the control unit 13 may decide thedetail of the control of the display. It should be noted that anumerical value and a detail that are indicated by the correspondenceinformation in FIG. 6 are examples, and that other details can beavailable.

At this point, the correspondence information that is illustrated inFIG. 6 is described. In the case of the correspondence information thatis illustrated in FIG. 6, if the face of a person is not extracted fromthe captured image (gaze detection that lasts for 0 seconds or more andless than 2 seconds—no faces detected), that is, if a person who facestoward the display is not present in front of the display, the controlunit 13 causes the display to operate in the power saving mode.

Furthermore, in a case where the face of a person is extracted from thecaptured image, but where the number of the persons who are viewing thedisplay is 0 (gaze detection that lasts for 0 seconds or more and lessthan 2 seconds—face detected: the number of gaze-detected persons is 0),in a customer attraction mode, the control unit 13 causes the display toperform an operation of drawing person's attention. In the customerattraction mode, for example, the audio saying “we provide usefulinformation” or the like may be output from the display, and a person'sattention may be drawn using a blinking light or the like.

Furthermore, in a case where the face of a person is extracted from thecaptured image and where a person who is viewing the display is present,the control unit 13 causes the display to perform processing inaccordance with the number of the persons who are viewing the displayand the display browsing time.

Specifically, in a case where the display browsing time is less than 2seconds (gaze detection that lasts for 0 seconds or more and less than 2seconds), the control unit 13 displays a guide message indicating thatpredetermined information starts to be provided from now on, using astill image (a digest or a moving image may be used). This guide messageis displayed on the entire display. That is, at this stage, the displayarea of the display is not divided into multiple sub-areas. It should benoted that the still image is not limited to the entire display beingnecessarily stationary, and a portion (for example, a letter, a symbol,or the like, which are not the advertisement itself) of the image maymove.

It should be noted that it is assumed that information which is to beprovided is set to be information in accordance with the number of thepersons who are viewing the display. For example, information on a store(for example, a diner) where one person alone can visit comfortably maybe provided in a case where the number of the persons who are viewingthe display is 1. Furthermore, information on a store for a couple (forexample, a place to bring a date) is provided in a case where the numberof the persons who are viewing the display is 2, and information on astore for a family (for example, a restaurant) is provided in a casewhere the number of the persons who are viewing the display is equal toor greater than 3.

Furthermore, when the display browsing time is 2 or more seconds (gazedetection that lasts for 2 seconds or more and less than 5 seconds), thecontrol unit 13 ends displaying the guide message. Then, the displayarea of the display is divided into multiple sub-areas (for example,four sub-areas), and pieces of information on multiple stores aredisplayed on the multiple sub-areas, respectively. For example, piecesof attribute information (a name, a place, a photograph of an externalappearance, a product, or the like) on the multiple stores are displayedon the multiple sub-areas, respectively, using a still image (a digestor a moving image may be used). The still image is not limited to anentire sub-area being necessarily stationary, and a portion (forexample, a letter, a symbol, or the like, which are not theadvertisement itself) of the image may move.

It should be noted that it is assumed that a store to be recommended isset to be a store in accordance with the number of the persons who areviewing the display. For example, a store (for example, a diner) whereone person alone can visit comfortably may be recommended in the casewhere the number of the persons who are viewing the display is 1.Furthermore, a store for a couple (for example, a place to bring a date)may be recommended in the case where the number of the persons who areviewing the display is 2, and a store for a family (for example, arestaurant) may be recommended in a case where the number of the personswho are viewing the display is equal to or greater than 3.

Furthermore, when the display browsing time is 5 or more seconds (gazedetection that lasts for 5 seconds or more and less than 30 seconds),the control unit 13 decides a sub-area (for example, a sub-area that isbeing viewed by the greatest number of persons, a sub-area that isviewed for the greatest time of period) that draws attention, of themultiple sub-areas. Then, a change is made to a layout of the displayarea of the display, and information on a store that is displayed on thesub-area which draws attention is displayed on a large-sized screen.Furthermore, a moving image containing detailed information on the storeis reproduced on the large-sized screen.

It should be noted that the control unit 13 may make a change to onlycontent that is displayed on the sub-area which draws attention in sucha manner as to display a moving image, without displaying the display ofthe large-sized screen described above and without making a change tothe layout of the multiple sub-areas on the display.

In this manner, the control unit 13 can display a still image in a casewhere the display browsing time is shorter than a fifth reference timeand can display a moving image in a case where the display browsing timeis equal to or longer than the fifth reference time. The fifth referencetime is arbitrarily set in advance.

Furthermore, when the display browsing time is 30 or more seconds (gazedetection that lasts for 30 or more seconds), the control unit 13displays coupon information on a store relating to the moving image thatis reproduced, on the display.

In this manner, when the display browsing time is equal to or longerthan the sixth reference time, the control unit 13 can display couponinformation on the display. The sixth reference time is arbitrarily setin advance.

It should be noted that, while, the display area of the display isdivided into multiple sub-areas and content is displayed on each of themultiple sub-areas, the control unit 13 may set a ratio of an areaoccupied by at least one of the multiple sub-areas on the display to bea ratio in accordance with a ratio of the number of the persons who areviewing the sub-area. Furthermore, the control unit 13 may performswitching on brightness of each of the multiple sub-areas on thedisplay, according to the number of the persons who are viewing each ofthe multiple sub-areas.

An example of processing by the apparatus 10 for providing informationaccording to the present example embodiment is the same as thataccording to the second example embodiment.

With the information providing system according to the present exampleembodiment, which is described above, an advantageous effect that is thesame as those according to the first and second example embodiments canbe realized.

Furthermore, with the information providing system according to thepresent example embodiment, switching of displaying on the display canbe performed. The number of the persons who are viewing the displayindicates an attribute of a person or a group that is viewing thedisplay. By providing content in accordance with the number of thepersons who are viewing the display, information suitable for the viewercan be provided.

MODIFICATION EXAMPLES

Modification examples applicable to the first to third exampleembodiments are described.

Modification Example 1

The control unit 13 may display information indicating a position on thedisplay, which is being viewed by a person extracted from the capturedimage, on the display. FIG. 7 illustrates an example of this. FIG. 7illustrates browsing positions of three viewers, with marks M1 to M3,respectively. It should be noted that multiple marks may bedistinguishable in appearance from one other on the basis of a color, ashape, or the like.

With the modification example, the viewer can easily recognize positionson the display, which is being viewed by the viewer or other persons. Asa result, in addition to being able to watch the display with a feelingof playing a game, the trend of other persons can be recognized.

Modification Example 2

The control unit 13 may control the display in such a manner thatdifferent items of content are viewed according to watching directions.For example, by dispersing light from the display in multipledirections, content can be viewed differently from the multipledirections. The displaying can be realized by utilizing a viewing anglecontrol technology. Furthermore, using a result of the image analysis bythe image analysis unit 12 makes it possible to determine from whichdirection of the multiple directions each viewer is viewing.

By utilizing the technology, for example, in a case where multipleviewer are viewing the same display or the same sub-area, a timing forreproducing the moving image described above or a timing for displayingthe coupon information can be caused to vary among viewers.

For example, the control unit 13 may decide content that is to bedisplayed on the display, in such a manner that a moving image is viewedfrom a position or an angle at which the number of the persons who arewatching the display is relatively great and that a still image isviewed from a position or an angle at which the number of the personswho are watching the display is relatively small. The still image is notlimited to an entire sub-area being necessarily stationary, and aportion (for example, a letter, a symbol, or the like, which are not theadvertisement itself) of the image may move.

For example, content that is viewed from the rightward direction of thedisplay, content that is viewed from in front of the display, andcontent that is viewed from the leftward direction can be set to bedifferent items of content. Specifically, when persons, of which thenumber is equal to or greater than a reference number, are viewing asub-are from the right side of the display and the sub-area browsingtime thereof is equal to or longer than the third reference time (orwhen either condition is satisfied), for the persons who are viewing thesub-area from the right side of the display, a moving image is displayedon the sub-area. On the other hand, for persons who are viewing thesub-area from in front of the display or from the left side of thedisplay, a still image is displayed on the sub-area in a case where thenumber of the persons viewing the sub-area from in front of the displayor from the left side of the display is smaller than the referencenumber and the sub-area browsing time thereof is shorter than the thirdreference time (or when either condition is satisfied).

In the modification example, suitable content can be provided to each ofthe multiple viewers.

Modification Example 3

The apparatus 10 for providing information may total up results of theanalysis by the image analysis unit 12 and may generate total data. Anexample of the total data is illustrated in FIGS. 8 to 11.

The total data in FIG. 8 results from computing the display browsingtime for every viewer who are currently watching the display andgraphing results of the computation.

The total data in FIG. 9 results from computing the number of viewersfor every time span and graphing results of the computation.

The total data in FIG. 10 results from computing an accumulated total ofthe sub-area browsing times for every sub-area (panel) (for example, anaccumulated total for one day) and graphing result of the computation.

The total data in FIG. 11 results from computing an average of thedisplay browsing times per one viewer and graphing results of thecomputation.

In the modification example, a utilization situation of the display canbe digitalized. Then, on the basis of the total data, a change can bemade to a position for disposing the display, a detail of content, orthe like.

Examples of a reference embodiment will be added as appendixes asfollows.

1. An apparatus for providing information, the apparatus including: anacquisition unit that acquires a captured image obtained by imaging thevicinity of a display; an image analysis unit that detects a position onthe display, which is being viewed by a person extracted from thecaptured image; and a control unit that divides a display area of thedisplay into multiple sub-areas, displays content on each of themultiple sub-areas, and makes a change to the displaying on the sub-areathat is being viewed by the person extracted from the captured image.

2. The apparatus for providing information according to 1, in which theimage analysis unit detects a sub-area browsing time that is a period oftime for which the person extracted from the captured image is viewingthe sub-area that is predetermined, and in which the control unitdecides content that is to be displayed on the sub-area which is beingviewed by the person extracted from the captured image, according to thesub-area browsing time.

3. The apparatus for providing information according to 2, in which thecontrol unit displays a still image in a case where the sub-areabrowsing time is shorter than a first reference time, and displays amoving image in a case where the sub-area browsing time is equal to orlonger than the first reference time.

4. The apparatus for providing information according to 2 or 3, inwhich, when the sub-area browsing time is equal to or longer than asecond reference time, the control unit displays coupon information.

5. The apparatus for providing information according to 2, in which theimage analysis unit further detects the number of persons who areviewing each of the multiple sub-areas, and in which the control unitdecides content that is to be displayed on the sub-area which is beingviewed by the person extracted from the captured image, according to thesub-area browsing time and the number of the persons who are viewingeach of the multiple sub-areas.

6. The apparatus for providing information according to 5, in which thecontrol unit displays a still image in a case where the number of thepersons, the sub-area browsing time of each of whom is equal to orlonger than a third reference time, is smaller than the first referencenumber of persons, and displays a moving image in a case where thenumber of the persons, the sub-area browsing time of each of whom isequal to or longer than the third reference time, is equal to or greaterthan the first reference number of persons.

7. The apparatus for providing information according to 5 or 6, in whichthe control unit displays coupon information when the number of thepersons, the sub-area browsing time of each of whom is equal to orlonger than a fourth reference time, is equal to or greater than thesecond reference number of persons.

8. An apparatus for providing information, the apparatus including: anacquisition unit that acquires a captured image obtained by imaging thevicinity of a display; an image analysis unit that analyzes the capturedimage, to extract a face of a person from the captured image and detectthe number of persons who are viewing the display, and a displaybrowsing time that is a period of time for which the display is beingviewed; and a control unit that decides content that is to be displayedon the display, according to a result of the detection.

9. The apparatus for providing information according to 8, in which thecontrol unit displays a still image in a case where the display browsingtime is shorter than a fifth reference time, and displays a moving imagein a case where the display browsing time is equal to or longer than thefifth reference time.

10. The apparatus for providing information according to 8 or 9, inwhich, when the display browsing time is equal to or longer than a sixthreference time, the control unit displays coupon information on thedisplay.

11. The apparatus for providing information according to any one of 5 to10, in which, in a case where a face of a person is extracted from thecaptured image, but where the number of the persons who are viewing thedisplay is smaller than a predetermined number, the control unit causesthe display to perform an operation of drawing person's attention.

12. The apparatus for providing information according to any one of 5 to11, in which the control unit sets a ratio of an area occupied by atleast one of the multiple sub-areas on the display to be a ratio inaccordance with a ratio of the number of the persons who are viewing thesub-area.

13. The apparatus for providing information according to any one of 5 to12, in which, the control unit performs switching on brightness of eachof the multiple sub-areas on the display, according to the number of thepersons who are viewing each of the multiple sub-areas.

14. The apparatus for providing information according to any one of 1 to13, in which the control unit individually makes a change to the contentthat is displayed on each of the multiple sub-areas, without making achange to a layout of the multiple sub-areas on the display.

15. The apparatus for providing information according to any one of 1 to14, in which, in a case where a face of a person is not extracted fromthe captured image, the control unit causes the display to operate in apower saving mode.

16. The apparatus for providing information according to any one of 1 to15, in which the image analysis unit detects a position on the display,which is being viewed by the extracted person, and in which the controlunit displays information indicating the position on the display, whichis being viewed by the person extracted from the captured image, on thedisplay.

17. The apparatus for providing information according to any one of 1 to16, in which the control unit controls the display in such a manner thatdifferent content items are viewed according to watching directions.

18. The apparatus for providing information according to any one of 1 to17, in which the control unit decides content that is to be displayed onthe display, in such a manner that a moving image is viewed from adirection in which the number of the persons who are watching thedisplay is relatively great and that a still image is viewed from adirection in which the number of the persons who are watching thedisplay is relatively small.

19. A method of providing information, which is performed by a computer,the method including: an acquisition step of acquiring a captured imageobtained by imaging the vicinity of a display; an image analysis step ofdetecting a position on the display, which is being viewed by a personextracted from the captured image; and a control step of dividing adisplay area of the display into multiple sub-areas, displaying contenton each of the multiple sub-areas, and making a change to the displayingon the sub-area that is being viewed by the person extracted from thecaptured image.

20. A program that causes a computer to function as: an acquisition unitthat acquires a captured image obtained by imaging the vicinity of adisplay; an image analysis unit that detects a position on the display,which is being viewed by a person extracted from the captured image; anda control unit that divides a display area of the display into multiplesub-areas, displays content on each of the multiple sub-areas, and makesa change to the displaying on the sub-area that is being viewed by theperson extracted from the captured image.

21. A method of providing information, which is performed by a computer,the method including: an acquisition step of acquiring a captured imageobtained by imaging the vicinity of a display; an image analysis step ofanalyzing the captured image, to extract a face of a person from thecaptured image and detect the number of persons who are viewing thedisplay, and a display browsing time that is a period of time for whichthe display is being viewed; and a control step of deciding content thatis to be displayed on the display, according to a result of thedetection.

22. A program that causes a computer to function as: an acquisition unitthat acquires a captured image obtained by imaging the vicinity of adisplay; an image analysis unit that analyzes the captured image, toextract a face of a person from the captured image and detect the numberof persons who are viewing the display, and a display browsing time thatis a period of time for which the display is being viewed; and a controlunit that decides content that is to be displayed on the display,according to a result of the detection.

This application claims priority based on Japanese Patent ApplicationNo. 2017-120735, filed on Jun. 20, 2017, the entire disclosure of whichis incorporated by reference herein in its entirety.

What is claimed is:
 1. An apparatus for providing information, theapparatus comprising: at least one memory configured to store one ormore instructions; and at least one processor configured to execute theone or more instructions to: acquire a captured image obtained byimaging the vicinity of a display; detect a position on the display,which is being viewed by a person extracted from the captured image;divide a display area of the display into multiple sub-areas, displaycontent on each of the multiple sub-areas, and make a change to thedisplaying on the sub-area that is being viewed by the person extractedfrom the captured image; detect a sub-area browsing time that is aperiod of time for which the person extracted from the captured image isviewing the sub-area that is predetermined; and decide content that isto be displayed on the sub-area which is being viewed by the personextracted from the captured image, according to the sub-area browsingtime.
 2. The apparatus for providing information according to claim 1,wherein the processor is further configured to execute the one or moreinstructions to display a still image in a case where the sub-areabrowsing time is shorter than a first reference time, and display amoving image in a case where the sub-area browsing time is equal to orlonger than the first reference time.
 3. The apparatus for providinginformation according to claim 1, wherein the processor is furtherconfigured to execute the one or more instructions to display couponinformation, when the sub-area browsing time is equal to or longer thana second reference time.
 4. The apparatus for providing informationaccording to claim 1, wherein the processor is further configured toexecute the one or more instructions to: detect the number of personswho are viewing each of the multiple sub-areas, and decide content thatis to be displayed on the sub-area which is being viewed by the personextracted from the captured image, according to the sub-area browsingtime and the number of the persons who are viewing each of the multiplesub-areas.
 5. The apparatus for providing information according to claim4, wherein the processor is further configured to execute the one ormore instructions to display a still image in a case where the number ofthe persons, the sub-area browsing time of each of whom is equal to orlonger than a third reference time, is smaller than the first referencenumber of persons, and display a moving image in a case where the numberof the persons, the sub-area browsing time of each of whom is equal toor longer than the third reference time, is equal to or greater than thefirst reference number of persons.
 6. The apparatus for providinginformation according to claim 4, wherein the processor is furtherconfigured to execute the one or more instructions to display couponinformation when the number of the persons, the sub-area browsing timeof each of whom is equal to or longer than a fourth reference time, isequal to or greater than the second reference number of persons.
 7. Theapparatus for providing information according to claim 1, wherein theprocessor is further configured to execute the one or more instructionsto individually make a change to the content that is displayed on eachof the multiple sub-areas, without making a change to a layout of themultiple sub-areas on the display.
 8. The apparatus for providinginformation according to claim 1, wherein the processor is furtherconfigured to execute the one or more instructions to cause the displayto operate in a power saving mode, in a case where a face of a person isnot extracted from the captured image.
 9. The apparatus for providinginformation according to claim 1, wherein the processor is furtherconfigured to execute the one or more instructions to: detect a positionon the display, which is being viewed by the extracted person, anddisplay information indicating the position on the display, which isbeing viewed by the person extracted from the captured image, on thedisplay.
 10. The apparatus for providing information according to claim1, wherein the processor is further configured to execute the one ormore instructions to control the display in such a manner that differentcontent items are viewed according to watching directions.
 11. Theapparatus for providing information according to claim 1, wherein theprocessor is further configured to execute the one or more instructionsto decide content that is to be displayed on the display, in such amanner that a moving image is viewed from a direction in which thenumber of the persons who are watching the display is relatively greatand that a still image is viewed from a direction in which the number ofthe persons who are watching the display is relatively small.
 12. Amethod of providing information, which is performed by a computer, themethod comprising: acquiring a captured image obtained by imaging thevicinity of a display; detecting a position on the display, which isbeing viewed by a person extracted from the captured image; and dividinga display area of the display into multiple sub-areas, displayingcontent on each of the multiple sub-areas, and making a change to thedisplaying on the sub-area that is being viewed by the person extractedfrom the captured image; detecting a sub-area browsing time that is aperiod of time for which the person extracted from the captured image isviewing the sub-area that is predetermined; and deciding content that isto be displayed on the sub-area which is being viewed by the personextracted from the captured image, according to the sub-area browsingtime.
 13. A non-transitory storage medium storing a program that causesa computer to: acquire a captured image obtained by imaging the vicinityof a display; detect a position on the display, which is being viewed bya person extracted from the captured image; divide a display area of thedisplay into multiple sub-areas, display content on each of the multiplesub-areas, and make a change to the displaying on the sub-area that isbeing viewed by the person extracted from the captured image; detect asub-area browsing time that is a period of time for which the personextracted from the captured image is viewing the sub-area that ispredetermined; and decide content that is to be displayed on thesub-area which is being viewed by the person extracted from the capturedimage, according to the sub-area browsing time.